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FOREWORD 


This  report  vai  prepared  by  Measurement  Analysis  Corporation, 
Lot  Angeles,  California,  for  the  Aerospace  Dynamics  Branch,  Vehicle 
Dynamics  Division,  AF  Flight  Dynamics  Laboratory,  Wright- Patterson 
Air  Fores  Bass,  Ohio  45433,  under  Contract  No.  AF33(6 15)-  1418.  The 
research  performed  i  part  of  a  continuing  effort  to  provide  advanced 
techniques  in  the  application  of  random  process  theory  and  statistics  to 
vibration  problems  which  in  part  of  the  Research  ((Technology  Division, 
Air  Force  Systems  Command's  exploratory  development  program.  The 
contract  was  initiated  under  Project  No.  1370,  "E/namic  Problems  in 
Flight  Vehicles,"  Taek  x!o.  137005,  "Prediction  and  Control  of  Structural 
Vibration,  "  Mr.  R.  G.  Merkle  of  the  Vehicle  Dynamics  Division,  FDD6, 

was  the  project  engineer. 
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This  report  covers  work  conducted  from  March  i%4  to  January 
1965.  ZTu»  contractor's  report  number  is  MAC  403-08.  Manuscript 
rsleassd  by  authors  February  1965  for  publication  as  an  Air  ForceFlight 
Dynamics  laboratory  Technical  Report. 
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ABSTRACT 


The  report  describe*  fundamental  concepts  involved  in  the 
statistical  analysis  of  ’multiple -input  single -output  time-invariant 
linear  system*.  The  definitions  of  a  matrix  frequency  response 
function  and  a  multiple  coherence  'unction  are  presented.  Also 
discussed  are  marginal  and  conditional  (partial)  coherence  func- 
with  emphasis  on  their  interpretations  V'i. 

Formulas  for  computing  simultaneous  confidence  bands  for 
all  elements  of  the  matrix  frequency  response  function  are  pre¬ 
sented.  Obtaining  these  confidence  bands  require  the  use  of  the 
standard  "F”  distribution.  Expressions  for  these  confidence  bands* 
are  given  both  as  a  function  of  the  various  t/pea  of  coherences  and 
of  the  elements  of  the  cpectralfdensity  matrix.  The  effect  of  the 
various  quantities  on  the  width  of  the  confidence  bar  ds  is  discussed 
in  detail.  Confidence  bands  for  the  gains  and  phases  of  the  fre¬ 
quency  response  functions  are  also  d-sveioped. 

The  interpretation  of  linear  system  computational  results 
In  terms  of  a  time  invariantnonlinear  system  model  is  described. 
It  Is  shown  how  ths  linear  system  reeuits  provide  what  may  be 
thought  of  as  a  '  best"  linear  fit  to  the  nonlinear  model.  The 
multiple  coherence  function  then  giver  a  quantitative  measure  of 
goodness  of  this  fit.  In  this  sense  the  coherence  function  may 
uted  to  provide  a  test  for  system  Unearity.  '  J  * 
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•  mall  frequency  bandwidth  of  spectral  analysis 
extraneous  noise  variable 
frequency  variable 

frequency  response  function  between  x^(t)  and  x^_(t) 
lxq  matrix  frequency  response  function  (f), . . .  ,  H^(f)  j 
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linear  time  invariant  operator  relating  record  x^(t)  with  x^(*) 

% 

number  of  effective  degree-of-freedom  in  coherence  estimato 

/'  r  • 
N  *  BT,  the  number  of  degrees -of-freedom  in  the  spectral  analysis 
where  B  =  analysis  bandwidth  and  T  =  record  length.  Many  other 
reports  use  the  convention  N  =  2BT,  double  the  value  defined  hei,  c. 

Use  care  when  comparing  results. 

total  number  of  records  (time  series)  in  analysis,  1.  e.  ,  the  dimension 
of, the  multivariate  random  process 

r  ' 

/ 

the  number  of  input  variables 

cross-spectral  density  function  of  x.(t)  and  x(t).  Power  spectral 
density  function  when  j  =  k.  ^ 

.  . .  1 

that  part  of  x  (t)  yhich  i*  a  linear  functional  of  x,  (t), ....  x  (t) ,  , 
Pl*  y  1  1  P1 

k=  1 , .  . .  ,  p  -  p . 


w  (t)  kth  conditioned'  process,  conditioned  on  x,(t),...,x  (t),  k=l, 

o . +k  ip. 


P[+k 

V*> 


kth  random  .proves  '  ^ 
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random  variable  which  is  estimate  of  parameter  x 
*  tri^sp o*e  of  when  x  denotes  a  matrix 
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IV»I 

||sJk(f)|| 


Yj-1,2(...  ,j-l,j+l,...p(£) 


matrix  with  clement*  S  '  (f) 

inverse  of  matrix  with  elements  S^(f) 

multiple  coherence  function  between  variable 

x  (t)  and  variables  x.  (t), x.  (t),x  (t), .  .  x  (t)- 

j  1  j-1  j+1  p 


*p*  p- 1,  p-2, . . p^+1  |l,  2, .  . pj  multiple  conditionai  coherence  between  x^(t)  *ad 

x  ,  (t),x  (t),  ...,x_  , .  (t)  when  conditioned  on 

pr i  p-6  Pj+i 

X.(t),  X,  (t),  ,  .  .,X  (t). 

1  i  Pj 

>{f)  phase  of  H(f) 
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2  (f) 

Vk 


pxp  spectral  density  matrix.  Elements  are  the 
spectral  ^density  function*  S.^(f). 

submatrix  of  2(f)  when  2(f)  is  partitioned 

the  conditional  spectral  density  matrix  of  the 

variables  x-  ,i(t),...,x  (t)  conditioned  on  the 
P  J  +  *  p 

variables  x^ (t), . . .  ,Xp  (t).  That  is,  the  spectral 
density  matri^  of  the 'time  series  x^p  ^(t), 
k»  1*  • . . ,  p-p^  •/  t  j 

qxq  spectral  density  matriat  of  Inpu^  variable* 

x  (t),...,x  (t)  .  |(  #  / 

H  /  «  *  * 

qx  1  [l  xq]  spectral/density  vector  of  input*  -  i 


qx  1  [l  xqj  spectral/density  vector  of  input*  -  i 
Xj(t),. . .  #x2(t)  with  output  y(t) 

lxl  spectral  density  matrix  of  output  y(t) 
^Identically  equal  to  ,yU)] 

the  conditional  spectral  density  matrix  of  an  out- 
put  variable  y(t)  conditioned  on  the  Input  vari¬ 
ables  x .  (t), .  . .  ,x  (t) 

1  q 

inverse  matrix  ofjasatjlx^  2(f) 

'  * 

the  kill  diagonal  elemental  the  matrix  2  (f) 


kk 

2«(£> 


the  kth  diagonal  element  of  the  matrix  2  (f) 
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1.  THE  MEASUREMENT  OF  THE  VARIOUS  TYPES  OF  QOHERENCE 


In  measuring  frequency  response  functions  and  in  many  other  applications, 

t 

for  example,  measuring  the  ki^.d^and  degree  of  relation  between  simultaneously 

recorded  vibration  records,  one  is  led  to  the  problem  of  measuring  coherences 

of  multiple  stationary  random  functions  (time  series).  There  are  various 
,  * 

, types  of  cohsrences.  Four  types  ar^  discussed  here.  They  are  (a)  multiple 

coherence,  (b)  marginal  multiple  coherence,  (c)  conditional  (or  partial) 

multiple  cohererce,  and  (d)  mai  ainal  conditional  multiple  coherence.  The 

various  types  of  coherence  mentioned  above  are  all  particular  functions  of  the 

^  * 

elements  of  a  spectral  density  matrix  of  a  multiple  stationary  time  senec. 

» 

(Formulas  for  the  various  types  of  coherence  will  be  stated  subsequently.  ) 

A  spectral  density  matrix  of  a  m’^ltiple  stationary  time  series  is  a  function  of 

frequency  f,  and  coherences  areithen  also  functions  of  frequency  f.  In  speaking 

of  a  spectral  density  matrix  or  / coherence,  one  is  really  speaking  of  a  spectral 

density  matrix  or  a  coherence  At  a  particular  frequency  f^. 

From  finite  length  reco^s  (e.  g.  ,  simultaneously  measured  vibration  • 

regarded  to  be  a  finite  length  sample  of  a  multiple  stationary 

time  series,  one  computes  irfan  appropriate  manner  sample  spectral  density 

i 

matrices  corresponding  to  a1  collection  of  frequencies.  To  be  more  precise, 
each  sample  spectral  densi tif  matrix  corresponding  to  a  particular  frequency  f^ 
in  reality  pertains  to  a  (usvyally)  small  frequency  band  of  bandwidth  B  centered 
at  frequency  f^.  It  is  convenient,  however,  to  speak  of  the  sample  spectral 
density  matrix  at  frequency  f^. 

The  sample  counterparts  or  estimators  for  the  various  types  of  coherences 
mentioned  above  are  obtained  in  the  following  manner.  At  a  particular  frequency 
fg  ,  each  sample  coherence  is  the  i-ume  function  of  the  elements  of  the  sample 
spectral  density  matrix  at  frequency  f  as  the  corresponding  true  coherence  is 
of  the  elements  of  the  true  spectral  density  matrix.  Subject  to  certain  hypotheses 


1 


the  joint  distribution  of  the  elements  of  a  sample  spectral  density  matrix  has 

* 

been  derived  in  closed  form  (Reference  l).  Furthermore,  it  is  demonstrated 

in  Reference  1  that  ii  the  frequencies  corresponding  to  the  collection  of 

sample  spectral  density  matrices  are  spaced  a  suitable  distance  -part,  the 
*  f 

sample  spectral  density  matrices  are  essentially  independently  distributed. 


(This  necessary  spacing  is  the  analysis  bandwidth  B  where  B  is  defined  in 
a  reasonable  manner.)  Since  sample  coherences  are  functions  of  the  elements 
of  a  sample  spectral  density  matrix  corresponding  to  a  particular  frequency, 


/ 


s 

/ 


sample  coherences  corresponding  to  different  frequencies  are  also  essentially  j 
independently  distributed  if  the  frequency  spacing  mentioned  above  prevails. 
With  such  a  frequency  spacing,  tf.e  statistical  uncertainty  of  sample  coherences 
may  then  be  described  separately  at  each  frequency  f^  . 


I  i 
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1.  t'  DEFINITION  OF  MULTIPLE  COHERENCE 

Formulas  for  ax?  interpretations  of  the  types  of  coherence  mentioned 
above  will  now  be  stated. 

1^®^  * i  (t)»  s. (t)i  •  •  •  |X  (t)>  x  ,  i  (t)» . « •  #  x  (t)  denote  a 
1  2  Pi  Pl  +  l  Pi^2 

Pj  +  P^  =  P^  order  multiple  stationary  time  series  possessing  the  p  x  p  spectral 
density  matrix  (at  frequency  f). 


In  Eq.'  (1)  the  element  S^tf)  of  the  matrix  £(f)  denotes  the  cross-spectral 

density  (at  frequency  0  between  *^{t)  and  x^(t)  ,  (j,  k  *  l . p).  A  spectral 

density  matrix  E(f)  is  always  Hernr.ltian  non-negative  definite.  It  will  be 
presumed  (for  the  pre*ent|discussipn)  that  the  matrix  E(f)  is  positive 
definite,  and  hence  non- singular.  Let 
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*o-S 


*  / 
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wbe^ihe  matrices  2^(0,  2^(0,  S^ff),  2^ ^ (f)  in  Eq.  (2)  are  the  sub- 
^ma^icea  of  2(f)  indicated  by  the  partitioning  in  Eq,  (1).'  L>et 

'•"*f  ■  -i-  -i  a  jk  |  .  '( 

•  >  2  {0  =|sJ*(f)|  f 

/  r 

The  multiple  coherence  at  frequency  f  between  x  (t)  and  [x1{t),x2(t),...  , 
ia  given  by  the  formula 


,.!<*>] 


a* 

1 » 2,  ,#• , 


(£)=  1  - 


S _ (f)  SPP(f) 


The  multiple  coherence  V  .  ,  {£)  ranges  between  zero  and  unity 

“*  *  . . .  p«l,z,,..,p-l 

And  measures  or  describes  the  degree  to  which  (at  frequency  f)  x^(t)  is 

related  to  ^x^(t),  x^(t), .  .  |  ,x^  ^(t)J  by  means  of  linear  time  invariant  operators 

L  k:l,...,p*l  acting  on  x^(t),  k=l,...,p-l  respectively.  Stated  another 

way,  _  ,(fl  measures  or  describes  the  degree  to  which  (at 

■  /  p*  l ,  L , . . .  ,  p- 1  ' 

frequency  f)  the  system  diagram  indicated  below  prevails. 


InEq.  (5).  L^.L^. 


L  .  denote  linear  time  invariant  operators. 
p,p-l 


A  multiple  coherence  of  z©<p  indicates  no  such  relation  prevails;  the  larger 
thf  multiple  coherence  is,  the  more  nearly  Eq.  (5)  represents  the  true 

i 

rejation  with  such  a  relation  prevailing  penectly  as  multiple  coherence  becomes 
unilty. 
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Since  the  subscripts  on  the  x(t)  may  be  regarded  at  arbitrary  labels, 

it  is  clear  h^l  Eq.  (4)  is  a  formula  for  other  multiple  coherences  (at  frequency  f).  t 

For  example,  the  multiple  cohe/snce  at  frequency!  between  x.(t)  and  thj^ 

remaining  (p- 1)  components  of  1  x  .  (t), ...,  x  (t)|  is  given  by  ' 

U  i  p  J  /  ( 

;  .  "  .  V, 


1 1 


. p«“-(»JJw*“wV 


Since  any  submatrix  of  E(f)  which  is  symmetric  with  respect  to  the 
main  diagonal  is  a  spectral  density  matrix  (at  frequency  f)  of  selected  com¬ 
ponents  of  Xj(t),  x^(t),,  ,  .  ,x^(t),  one  may  employ  such  lubmatricea  to  compute 
other  multiple  coherences.  Such  multiple  coherence*  are  termed  marginal 
multiple  coherences  or  simply  multiple  coherences,  when  proper  subscript 
notation  indicates  which  components  are  involved.  For  example,  if  one 
considers  f  x ,  (t) . x  (t)l  then  y^  .  ,  *  (f)  is  the  multiple 

L  1  P1  J  pr*'2 . V" 

coherence  at  frequency  f  between  x  (t)  and  I  x.  (t), . . .  ,  x  .  (t)  .  To  com* 

z  pi  1  ' pi“l 

pute  V  ,  ,  .  (f)  one  starts  with  the  submatrix  F.  (f)  of  F(f)  and 

pf1*2 . prl  -  11 

suitably  applies  the  formula  given  by  Eq.  (4).  It  is  clear  that  the  interpretation 
of  marginal  multiple  coherences  is  the  same  as  that  for  multiple  coherences. 


1.2  CONDITIONAL  (PARTIAL)  COHERENCE 

With  respect  to  Eq.  (1)  there  is  a  matrix  computation  that  may  be 
performed  on  S(f)  to  yield  a  spectral  density  matrix  of  smaller  dimensions. 
Such  a  smaller  spectral  density  rrs  trix  is  called  a  conditional  (or  partial) 
spectral  density  matrix.  The  formula  for  comput/ng  such  a  matrix  and  its 
interpretation  will  be  explained  with  the  partitioning  and  submatrices  appearing 
in  Eq.  (l)  and  Eq.  (2). 
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Consider  ths  p^  Hermitian  matrix  defined  by: 

*  *  t  / 


+  l . p|».2 . Pl 


(f)  «  Zzz(i)  U)SJ2(f)  (6) 


Recall  that  Zj^ff)  ia  »  P2*P2  "l?11411311  (wh«re  p2  =  p-pj),  ^(f)  and  Z12^ 

are  p^  xp^  and  P}XP2  respectively,  and  E^U)  1*  PjXp^.  Since  2(f)  is 

positive  definite,  it  follows  that  2  .  ,  i.  ,  (f)  is  positive 

Pl+1 . Pi1*2 . Pi 

definite  (and  hence  also  non- singular).  Since  2  .  ,  i,  ,  (f)  is  a 

P|+1 . p|‘.2 - Pt 

p  xp  Hermitian  positive  definite  matrix  it  could  be  the  spectral  density 

>  b  M 

matrix  (at  frequency  f)  of  a  p^th  order  multiple  stationary  time  series 
[w  +l(t),...,w  (t)]..  With  respect  to  the  discussion  on  multiple  coherence  of 
the* previous  section,  it  is  possible  to  represent  the  p^th  order  multiple 
stationary  time  series  £x^  +j(t), . . .  ,x^  (t)]  tiie  following  form: 

4  >  f 

xPl+i<‘>*l-nlit‘,+  LuI2(,,  +  ---  +Lip,  xp1(t,  +  wp1+i('> 
Ip1t2(,)  *  L21  xl">  *  L22  x2(t|  *  *  L2P[  xPl<*>  *  Wp1*2<0  <7> 


x  (t)«  L  .  x.(t)  +  L  ,  x  (t)  +  , . .  ♦  L  x  (t>  +  w  (I) 
P1  P2  p2*  1  p22  2  P?P:  P*  pi  +p5 


2*i  rl 


1  r2 


The  interpretation  of  Eq.  (7)  is  as  follows.  Jin  Eq.  (7),  fx,(t),.  .  .  ,x  (t), 
*1  1  1  .  P1 
x  .  (t),  .  .  .  x  (t)  is  the  original  p  +p,  =  pth  prder  multiple  stationary 

p^l  Pl+P2  J  1  *  * 

time  series  of  the  previous  section.  The  of  Eq.  (7)  represent  linear  time 

invariant  operators.  One  furthermore  has  I  w  ,  ,  (t), .  .  .  ,  w  (t)  , 

t  Pj+1  Pi+P2  J 


6 


1 


* 


*  p,th  order  multiple  stationary  time  eerie*  with  each  of  ita  component* 

Wp  ^(t),  (h=l, . . .  ,  p^),  possessing  a^  all  frequencies  f  a  multiple  coherence 

of  zero  with  ^Xj(t),  x^[t),...,x^  (t)j.^  The  preceding  property  of  the  w/ 

may  be  explained  roughly  as  follow*.  ^  Vtie  component*  w  ,,  (t),  k=l,.'..  ,  p,, 

/  7  pi  k  '  2 

are  the  original  component*  x  M,  k=l,. ..  ,p,  with  the  linear  "effect"  of  the 

Pj+k'  i 

remaining  component  x.(t),  j=  1 ,  U*.  p,  ,  subtracted  out.  Since  the  linear 

J  J  if!  1 


"effect"  between  x  . ,  (t),  k frpy,  and  Xj{t),  j=l, .... pj, has  been  sub- 


Pl"k 


tracted  out  to  obtain  each  w^  ^^(t),  the  multiple  coherence  between  each 
Wp  +^(t)  and  £  Xj  (t), .  .  .  ,  x^  {t)j  is  zero.  Thep^xp^  spectral  density  matrix 
of  fw  (t),...,w  +  (t)1  in  Eq,  (7)  i*  given  by  Eq.  (6). 

The  representation  Eq.  (7)  is  unique,  and  one  may  write  formulas 
expressing  the  frequency  response  functions  H„  (f)  corresponding  to  the 
in  terms  of  the  elements  of  the  spectral  density  matrix  Z(f)  of  Eq.  (1).  The 
formulas  for  the  frequency  response  functions  H^tf)  are  not  stated  here  since 
they  are  not  needed  for  the  present  discussion.  However,  let  / 


V  +  l  5  LU*l<t>+L12*iWt—  +  Llp,  V*1 


1 


VP)*2  8  L21«,(t)+L22*2(t)+...  *LZp  xp  M 


(S) 


'1  H 


^Pl+P2  “  Lp,lXl(t)  +Lp,2X2(t)  +  '--  +Lp,pTXPl(t>  * 

m  1  1 


* 


From  the  discussion  on  multiple  coherence  of  the  preyidu*  section,  it  is  clear 

that  v  4-,  (t), .  .  .  ,  v  ,  (t)  is  a  p,th  order  multiple  stations  .  y  time  series 

L  P.  1  P.+P,  J  2 


p|tp2 

with  each  of  its  components  •  (t ) ,  (k=l,...,p  ),  possessing  at  all 

Pj+k  L 
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frequencies  f  a  multiple  coherence  of  unity  with  ^Xj(t),  x^ft),  ...,x^  (t)  j  . 

That  is,  by  construction,  there  is  a  perfect  linear  relation  between  v  (v), 

Pl+k 

k=l, .  .  -  ,  p,  and  x.(t),  j  =1, .  ,  p..  Now,  from  Eq.  (8),  one  may  write  Eq.  (7) 

4  j  l 

in  the  form  (uniqxiely) 


where  the  V  component  is  perfectly  coherent  at  all  frequencies  f  and  the 
W  component  is  perfectly  incoherent  at  all  frequencies  f,  with  [xj(t),..,  ,x^  (t)J 
The  conditional  (or  partial)spectral  density  matrix  2  |  (f/ 

Pl+l . p  ji.  2, . . . ,  Pl 

therefore  is  the  p,  x  p.  spectral  density  matrix  of]  x  (t), .  . .  ,x  (t)l 
L  l  t  p^+i  P1*P2  J 

after  subtracting  from  [x^  +  ^t), . .  .  ,  x^  (t)]  that  part  which  is  attributable 

to  the  linear  time  invariant  operators  aciing  or.  [xj(t), . . .  ,x^  (t)J  . 

A  conditional  (or  partial)  multiple  coherence  is  a  multiple  coherence 
computed  from  a  conditional  (or  partial)  spectral  density  matrix.  The  formula 
for  a  conditional  spectral  density  matrix  is  given  by  Eq.  (6);  the  formula  for 
a  multiple  coherence  by  Eq.  (4).  Appropriate  identification  of  submatrices  and 

I 

use  of  Eq*.  (6)  and  (4)  enable  conditional  multiple  coherences  to  be  determined 
from  2(f)  of  Eq.  (1), 
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4/ 


The  following  example  illustrates  the  notation  for  conditional  multiple 
coherence.  The  multiple  coherence  (at  frequency  f)  between  x^(t)  and 
£x  ^(t) . x  +  ^(t)J  *itcr  conditioning  on  £x^(t),  (t)j  is  denoted 

2  *  * 
by  v  .  _  ,  ,  I,  ,  (f).  To  be  specific,  if  a  two  input  x,  (t) 

p*  p- 1,  p-2, .  .  .  ,  p.  +  l  11 , 2, .  . .  ,  p.  r  r  1 

V  1 

and  x^(t),  single  output  Xj(t)  ,  linear  system  is  being  analysed  then  the  multiple 
conditional  cohereuce^etween  x j  (t)  and  x^(t)  conditioned  on  x^ft)  is  denoted 
by  3j2(f).  This  special  case  reduces  the  ordinary  (2 -dimensional)  coherent  ; 
between  a  (t)  and  x_(t)  after  conditioning  on  x  (t)  and  is  discussed  in  detail 
in  Reference  5  with  a  slight  change  in  subscript  notation.  A  conditional  multiple 
coherence  measures  or  describes  the  degree  to  which  (at  frequency  f)  a  com¬ 


ponent  x  (t)  is  related  by  linear  time  invariant  operators  toother  components 
P 

x  ,  (t),...  ,  x  ,  (t)  after  "effects"  due  to  linear  time  invariant  relations  with 

p-1  p  +1 


other  components  x.  (t),  x  (t), . . . ,  x  (t)  have  been  subtracted  from 

It 

*  (t)t  *  ,(t), . .  >  ,*  .  ,(t). 

P  P-1  Pj+1 

A  marginal  conditional  multiple  coherence  is  a  marginal  multiple 
coherence  computed  from  a  conditional  spectral  density  matrix.  The  previous 
discussions  on  marginal  rmJtiple  coherence  and  conditional  multiple  coherence 
indicate  how  marginal  conditional  multiple  coherence  is  to  be  interpreted. 

The  following  example  illustrates  the  notation  for  marginal  conditional  multiple 
coherence.  The  marginal  multiple  coherence  (at  frequency  f)  between  V*> 
and  the  components  [  Xp_  j(t),  xp„2^]  °*  [Xp_l^*  Xp-2^'  Xp-3^' "  V  *Pj  +  l  • 
after  conditioning  on  [xj(t),*2{t), . . .  ,x^  (t>]  1  s  denoted  by  y  p.  p  l  p  2  1  1 

More  specifically,  if  a  three  input  [  x.(t),  i=l,2,  3]  single  output  x^ft)  linear 
system  is  under  consideration,  :hen  Y*.  ^(O  *•  the  marginal  multiple 
coherence  between  the  input  x^t)  and  the  output  x^t).  In  this  case  the 
conditioning  is  on  x.^(t)  and  the  third  input  x3(t)  is  effectively  ignored. 


9 


1.  3  THE  DISTRIBUTION  OF  SAMPLE  COHERENCE 

From  the  above  discussion  on  coherence  end  ample  coherence  it  i* 
clear  that  (at  a  particular  /requency  f^)  the  various  sample  coherences 
corresponding  to  the  v*ricvts  types  of  coherence  are,  in  general,  different 

A 

functions  of  the  e'err.  mts  of  the  sample  spectral  density  matrix  23(f^) 
corresponding  to  the  spectral  density  matrix  E(fg)  of  Eq.  (1).  (The  hat  "A  " 
notation  will  denote  a  sample ^estimatejof  the  indicated  quantity)  The  statistical 
distribution  corresponding  to  each  type  of  sample  coherence  cltl--  'd  above 
has  been  derived,  and  the  results  obtained  in  closed  form.  (See  Re/e  re nee* 

1  and  2.  )  The  statistical  distributions  of  the  various  types  of  sample  coherence 
are,  in  general,  different.  That  is  clearly  to  be  expected.  Howeve^i^tne 
probability  density  function  of  the  distribution  of  the  four  types  of  sample 
coherence  defined  above  may  be  expressed  by  the  following  general  formula: 

Let 

n  =  effective  number  of  degrees -of-freedom, 


p  =  effective  number  of  record* 
y2  3  true  coherence 
-Y~  *  y  x  nample  coherence 


(10) 


The  probability  density  function  of  any  type  of  sample  coherence  defined 
above  is  then  given  by 


C(y|n,p,  y2)  - - -  (l-Y2)”)1^  2  (l-y)n”P  F(n,  n;p-l;y2y),  (0<  y  <1) 

r(p-i)  r(n-p+l) 

2 

In  Eq.  (11),  F(n,  n;p-  1 ; y  y)  i«  the  hypergeometric  function  with  the  indicated 

parameters  and  variable*.  The  method  of  determining  the  parameters 
2 

n,  d,  y  of  Eq.  (10)  for  the  various  types  of  sample  coherences  defined 
previously  is  now  described. 


10 


With  respect  to  Eq.  (11)  let  N  =  BT  denote  the  effective  number  of  degree*-of- 
treeaom  of  the  spectral  density  estimator  £(f  J  of  21(f  ).  For  *  sample  multiple 
coherence' or  a  sample  marginal  rAuftiple  coherence  n  =  N.  For  any  sample 
conditional  cohe^nc^  n  =  N*»-  where  p^  denotes  the  number  of  components 
that  have  been  conditioned/  For  any  type  of  sample  multiple  coherence,  the 
parameter  p  is  givep  by*  the  total  number  of  components  involved  in  the  conerence 

relation  (not  in  general  the  total  number  of  components  of  the  multiple  stationary 

2  ^ 

time  series).  The  parameter  y  is  always  the  true  value  of  coherence  whatever 
the  type.  Examples:  With  reference  to  Eq.(ll)  and  the  previous  discussion 

*•  F°r  V  1.2 . p-l(V  #M  h“  "  =  N.  p  =  p,  .nd  ■  Y2  ,_2 . ,<V 


A  2 


2  2 


b*  For  V_  .  i  2  D  .<*«>  on«  n=N,p=p.,  and  y  3  y  .  i  ?  _  .tf0) 

P1  1,2 . P1  1  °  1  pl  1'2-“pl-1  0 

A2 

c-  For  Vp-l.P-2 . Pj+lll.2 . ,y  one  h-a  n  =  N-Pr  P*P2  • 

2  ,  ,M . 

P*  P’ l  *  p-2, .  . . ,  Pj  + 1 1 1 , 2, . . .  ,  Pj  0 

a-  ForVp.  ,-2|l,2 . Pl<V  on.  h.<n.N-pl,pO. 


2  2 
and  Y  *  Y, 


and 


*  Yp*  p-l,p-2|l,2 . Pl 


For  more  concrete  examples,  assume  a  three  input  [x^(t),  i=l,2,3]  single 
output,  x^(t),  linear  system  with  N  degrees-of-freedom  in  the  measurements. 

a.  The  sample  multiple  coherence  between  the  output  x^(t)  and  the 

inputs  is  y2  .  7  (f)  and  one  has  n  =  N,  p=4  and  y2=  y2  (f). 

b.  The  sample  marginal  multiple  coherence  between  the  input  x ^ (t )  and 

the  inputs  x,(t)  and  x  (t)  while  ignoring  the  output  x  (t)  is  y2  (f) 
*  £  4  y  \ ,  c 


»  Vt«  a  n  “■  M  r\  -  ^  \j  *» 


v2 


(f) 


i 


The  sample  conditional  multiple  coherence  between  the  output  x^(t) 

/  a2  4 

and  the  two  inputs  x^tt)  and  x ^(t)  conditioned  on  x^(t)  is  ^  2|l  ^ 

and  one  has  n-N-1,  p=3,  and  y  =  3  2jl^^* 

The  sample  marginal  conditional  multiple  coherence  between  the 
outpuTTX -Tt)  ani  the  input  x,(t)  while  conditioning  on  x.(t)  and 

»  ^2  ^  *  2  2  #  **  ** 

ignoring  y^  3 j  1  )  *nd  one  has  n=N- 1,  p=2,  and  y 


Tables  of  the  cumulative  distribution  function  corresponding  to  the 
probability  density  function,  Eq.  (11),  aave  been  calculated  for  the  parameter 
p  ranging  from  two  through  ten,  and  for  n  such  that  p  <  n  <  20(Reference  3). 
The  ru^es  for  n  and  p  described  above  may  be  applied  in  order  to  properly 
make  use  of  these  tables. 
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2.  THE  MEASUREMENT  OF  MATRIX  FREQUENCY 
RESPONSE  FUNCTIONS 


Consider  q  time  functions  x^(t),. 
related  by  the  equation: 


.  ,x  (t)  and  a  time  function  y(t) 

q 


y(*L ^(t)  +  L2  x2(t)  +  . . .  +  x^(t)  +  e(t)  .  (12) 

In  Eq.'*^^)  the  Ly  ,  k=  1 , .  .  .  ,  q  denote  linear  time  invariant  operators 
posers strife  corresponding  frequency  respoi.se  functions  k  =  1 , .  ,  .  ,  q. 

I  , 

The  function  eft)  is  presumed  to  be  a  zj^ro  mean  stationary  Gaussian  random 

function  statistically  independent  of  *^(0*  k=l,...  ,  q.  The 

spectral  density  S  (f)  of  e(t)  is  pfefeumed  unknown-  The  frequency  response 
e  . 

functions  H^(f)»  k=l,...,q  are  also  presumed  to  be  unknown. 

Equation  (12)  may  be  viewed  as  expressing  the  multiple -input  single-output 
(with  extraneous  noise)  block  diagram  illustrated  below. 


Xjft)- 


x2(t)' 


Hj  (f) 


H,  (f) 


H  (f) 

q 


Lj  Xj(t 


L2X2(t) 


x  (t) 

q  q 


y(t)  (13) 


The  1  xq  (complex  valued)  matrix 


H(f)  =  [hx  (f) . H  (£)]  =  [H1R(f)>  iHlx(f) . HqRW  +  iHqI<f>] 


is  called  the  matrix  frequency  function  of  Eq.  (12)  or  equivalently  of  the  system 
described  by  the  block  diagram. 
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2.  1  FREQUENCY  RESPONSE  FUNCTION  ESTIMATES 

Suppose  7  single  finite  realization  0  £  t  £  T  of  the  function^ 

(t), . . .  tX^(t),  y(t)  of  Eq.  (12)  is  observed  (recorded).  From  the  finite 

length  observed  records  of  £x^  (t), . .  .  ,  x^(t) ,  y(t>]  sirr.  lltaneou*  confidence 

bands  for  the  elements  of  the  matrix  frequency  response  function  H(f^)  at  a 

particular  frequency  f^  are  to  be  determined.  A  discussion  analogous  to  that 

of  Section  1  establishes  that  estimators  for  the  matrix  frequency  response 

I 

function  at  a  collection  bf  frequencies  are  essentially  statistically  independent 
if  the  frequencies  are  spaced  suitably  apart.  Thus,  with  such  a  frequency 
spacing,  simultaneous  confidence  bands  for  the  elements  of  the  matrix 
frequency  response  function  H(f^)  may  be  independently  determined  at  each 
particular  frequency  f^. 

An  estimator  H(f^)  for  ^he  matrii  frequency  response  function  H(f^) 
is  obtained  in  the  following  manner.  The  finite  length  (0  <  t  <  T)  of  records 
^Xj(t),.  . .  ,  x^(t),  y(t)]  are  treated  as  If  they  were  a  finite  realization  of  a 
(q+l)th  order  multiple  stationary  time  series.  Proceeding  by  the  method  of 
spectral  estimation  (Reference  1)  a  (q+l)x(q+l)  sample  spectral  density  matrix 
at  frequency  fQ 


\>  * 


L<v 


£  (f  j 

yx  0 


£  (fj 

xy  0 


£  (fn) 

yy  o 


is  then  computed.  It  is  presumed  that  the  degrees-of-freedom  parameter  n 

associated  with  £(f  )  satisfies  n  £  q  +  1.  It  is  also  assumed  that  the  q  x  q 

A  .  °  A 

matrix  E  (f  )  is  non-singular.  The  estimator  H(f  )  for  H(f  )  is  then 


KyV  . fyo>T=PlE<V*iSlI(,0> . ft=R(t0>+;V' 
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2.  2  CONFIDENCE  BANDS  FOR  MATRIX  FREQUENCY  RESPONSE  FUNCTIONS 


At  frequency-  the  cample  conditional  apectral  density  of  y(t)  conditioned 


on[x1(t), . . .  ,x  (t)]  ia 


A  A  A  A  *•  \  A 

2  ,  (fA)  =  E  (f  J  -  2  (f  J  Z  (fj  Z  (f  J. 

yix  0  yy  0  yx  0  xx  0  xy  0 


(17) 


Define  the  two  quantities 

•  A 


A(V  2  Wo1 


S<v 2  |fi(V  -  H(V  ( »(V  -  H(V 


)■ 


(18) 


As  a  special  case  of  general.ieajUt*  summarized  in  Reference  4,  it  follows 

_ 

that  under  appropriate  hypotheses  the  quantity 


n-q 

q 


A(f0> 


possesses  the 


standard  F  distribution  with  2q  and  2(n-q)  degrees -of •freedom.  The  cumu¬ 
lative  distribution  of 


A'V 

A(f0)  +  B(f0) 


(19) 


is  therefore  directly  and  easily  determined  from  the  cumulative  7  distribution. 

Without  going  into  hypotheses  details,  it  is  nevertheless  important  to  mention 
here  that  the  hypotheses  do  not  involve  statistical  distribution  conditions  on 
the  input  functions  x^(t),. . .  ,  x^(t).  For  example,  the  input  functions 
x^t), , . .  ,x^{t)  -i'e  permitted  to  be  nonstationary  or  nonrandom,  etc. 

Given  a  probability  (confidence  level)  p  (0  <  p  <  1)  one  may  then, 

U  v 

using  the  distribution  result  stated  above,  determine  the  corresponding  unique 
constant  a^fO  <  a^  <  i)  so  that 


Prob 


r. 


A 

A(f. 


I 


) 

0 


A 

♦  B(f, 


)  J 


=  P  r 


(20) 


15 


7  '• 


From  £q.  (18)  and  Eq.  (20),  using  various  algebraic  results  and  inequalities 
(Reference  4),  the  simultaneous  confidence  bands  for  all  the  elements  of  the 
matrix  frequency  response  function  H(f^)  stated  below  are  obtained. 

rivo>-Vo>f<fe-‘iVo>^<v]>p_  Bi 


In  Eq.  (21),  £  (f  )  is  given  by  Eq.  (17)  and  ^^{f  ),k*  1, ...,  q  denote 

the  indicated  diagonal  elements  of  the  q  x  q  matrix  2^  (fQ)  where  the  matrix 

E  (f  )  is  defined  in  Eq.  (15). 
xx  U 


2.  3  CONFIDENCE  AS  FUNCTION  OF  COHERENCE 

For  the  case  where  the  inputs- x^(t), ...  ,x^(t)  are  stationary  random 
functions,  it  is  desirable  for  interpreting  and  describing  results  related  to 
the  measurement  of  frequency  response  functions  to  rephrase  Eq.  (21).  From 

A  / 

Eq.  (15),  2  (fn)  is  the  qxq  sample  spectral  density  matrix  at  frequency  f 

XX  U  v 

of  the  multiple  inputs  x^(t),. .  .  ,x^(t).  Also  from  Eq.  (15)  one  may  regard 

to  ***«  ^  x  ^  naarginal  spectral  density  matrix  of  the  (q+l)x(q+l) 

sample  spectral  density  matrix  £(fg)  marginal  on  Xj(t), . . .  ,  x^(t). 

From  Reference  1,  the  sample  multiple  coherence  at  frequency  f^ 
between  the  input  x^(t)  and  the  other  (q-l)inputs  Xj(t),...,x^  .  (t),  x^+ ^  (t), ...  ,  x^(t) 
is  given  by 


Xk'xr.  .  .  ,xkl,xk+1,. .  .  ,x  0 


dj  =  i  - 1? 


x,  x.  0  xx  O  f 
k  k 


(k=l.  . .  , q)  (22) 


In  Eq.  (22),  2  ^  (f^)  denotes  the  sample  spectral  density  at  frequency  f^  of 

x,  (t)  and  Skk(f  }  is  defined  at  the  conclusion  f  Section  2.2.  From  Eq.  (22) 
k  xx  0 

one  obtains 


/ 


/ 
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1 


(23) 


w  ■  — ^ 
(1  - 


)  =  „  (f  j 


V‘i . Vi'Vi . *,  Vk  0 


a2 

Let  v  (f  )  denote  the  sample  multiple  coherence  at  frequency 

y  x. ,  x. , . .  . i x  u 
1  2  q 

f  between  the  output  y(t)  and  the  q  inputs  x.(t),  x_(t),...,x  (t).  On  applying 
0  icq 

the  equation  for  sample  multiple  coherence  (Reference  1)  to  the  matrix  2(f.) 
given  by  Eq.  (15),  performing  the  necessary  matrix  calculations  and  using 
Eq.  (17),  one  obtains 


VV  ■  1 


a2 

Vv  v 


.«q(v)vv 


From  Eqs.  (23)  and  (24)  one  may  write  Eq.  (21)  in  the  form 


Prob 


(a2  A 

1  (fn)  2  (fj  -» 

™  •-  p  . *  - 1  ,,, 

'\  Vxi . VrVi . xjVk  0  >Po 


(k  a  i,..,  ,q) 


Equation  (25)  expresses  the  simultaneous  confidence  bands  for  all  the  elements 
of  the  matrix  frequency  response  function  H(fg)  in  terms  of  the  sample  multiple 
coherence  between  the  output  and  all  the  inputs,  the  sample  multiple  coherence 

between  each  input  and  all  t^e  other  inputs,  and  the  ratio  between  the  sample 

■  .  *  •  i 

output  spectral  density  to  the  sample  input  spectral  densities. 

From  Eq.  (25)  one  may  discern  h<?^r  the  various  sample  coherences, 
sample  spectral  densities,  and  parameter*  q  and  n  govern  the  accuracy  with 
which  frequency  response  function*  are  measured.  One  notes,  for  example, 
that  the  accuracy  with  which  frequency  response  functions  are  measured; 
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a.  Improve*  a*  the  cample  multiple  coherence  between  the  output 

*2 

and  inputs  y  (f  )  increases  toward  unit/, 

y‘xl*x2***‘  * Xq  0 

b.  diminishes  as  sample  multiple  coherences  between  inputs 
increase, 

c.  improves  a«  sample  input  spectral  densities  increase, 

d.  improves  as  the  dcgrees-of-freedom  parameter  n  increases 
(since  for  fixed  pQ  and  q  the  "constant"  (aQl  •  1)  diminishes  as 
n  increases). 


The  distributions  of  the  sample  coherences  appearing  in  Eq.  (25)  are 

given  by  Eq.  (11).  For  y^  (fA)  the  pcrameter  p  in  Eq.  (11) 

/•  x. ,  X-, . . .  ,  x  0 

is  p  =  q  +  1.  For  the  sample  coherences  y  (k=l, . . .  ,  q) 

xk'x1,...  ,xk  l  xk+1> 

the  parameter  p  in  Eq.  (11)  is  p  =  q.  In  all  cases  y^  in  Eq.  (11)  denotes 
the  true  value  of  the  respective  coherences. 

The  simultaneous  confidence  bands  on  all  the  elements  H^U^)  (k=l,. . .  ,  q) 
of  the  matrix  frequency  response  function  H(fQ)  given  by  Eq.  (25)  are  determined 
by  the  sample  frequency  response  functions,  ths  sample  coherences,  and  the 
sample  spectral  densities  appearing  in  Eq.  (25).  It  is  important  to  notice  that 
one  requires  no  a  priori  knowledge  of  the  frequency  response  functions,  the 
coherences,  or  the  spectral  densities  to  determine  the  confidence  bands  on  the 
elements  of  the  matrix  frequency  response  function  H(f^)  in  using  Eq.  (25). 

One  may  also  use  Eq.  (25)  as  a  guide  in  planning  measurement  programs 
or  experiments  to  deterrrtine  the  elements  of  a  matrix  frequency  response  function 
H(f).  When  that  is  done, a  priori  estimates  or  knowledge  of  sample  coherences 
and  sample  spectral  densities  expected  to  be  obtained  are  substituted  in  Eq.  (25) 
and  the  results  yield  apriori  estimates  of  accuracies  with  which  the  elements 
of  a  matrix  frequency  response  function  H(f)  will  be  determined.  If  one  is 
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limited  to  only  measuring  the  inputs  and  output  one  is  then  only  able  to  estimate 
the  degrees -of-freedom  parameter  n  (or  alternatively  the  lengths  of  record  and 
frequency  resolutions)  needed  to  approximately  achieve  desired  accuracy  in 
measuring  frequency  response  functions.  If  one,  say  in  some  experiment,  is 
able  to  control  or  select  the  inputs  to  some  degree  more  may  be  achieved.  In 
that  regard,  the  previous  remarks  (on  how  coherences  and  spectral  densities 
govern  the  accuracy  with  which  frequency  response  functions  are  measured) 
become  especially  helpful.  For  example,  one  would,  if  possible,  select  Inputs 
that  are  incoherent  with  each  other. 


2.  4  CONFIDENCE  BANDS  FOR  GAIN  AND  PHASE 

i 

In  ViOBt  applied  work  one  customarily  expresses  frequency  response 

/  '  i ' 

functions  in  terms  of  gains  and  phasee.  From  Eq.  (25)  simultaneous  confidence 
bands  on  all  the  real  parts,  the  imaginary  parts,  the  gains,  and  the  phases  of 
the  frequency  response  functions  i’^fg),  k=l,. . .  ,q,  may  be  obtained.  With 
reference  to  Eq.'  (25),  let 


ll-y2  {fj|£  tfn> 

A 2  -1  »  *'x\’x2 . xq  0  I  rr  0 

r  k<V  *  <‘0  -»>— ^ - 3 - — - 

Vxi . VrVi . \ 


,  (k=  1 ,  • .  .  ,  q) 


Furthermore,  let 


=  HkR(£0)  +  lHkI(f0)  -lHk(£C)l*^<f°)  '  (27) 


W5^RV  +  lW-!Wl^tf(,>  •  {k=l . q)  (28) 


Equation  (27)  defines  the  real  parts  H^^l,  irnaginary  parts  H^(fg), 


19 


the  gain*  J  H^(fQ)  j ,  and  the  phaaea  (f Q)  of  the  frequency  ’■eaponae  functiona 

H^(f  ).  k=i,. .  .  ,q.  Equation  {28)  define*  the  aample  real  parta  H^^),  the 
aar^iple  gaina}  ^(fg)}  ,  the  aample  imaginary  parta  H^fg),  and  the  aample 
phaaea  $k(fQ)  °*  <lie  frequency  reaponae  functiona  H^fg),  k=l.. . .  ,  q.  Conaider 
the  diagram  aketched  in  Figure  1  below. 


r  v^o 


"  w 


Kv 


w 


Figure  1.  Confidence  Band  Diagram 


In  drawing  the  diagram  of  Figure  1,  it  ia  preaumed  that  r 


One  has 


A  Vv 

(fJ  =  Arc  ain  — - r  .  (k=l,..., 


ffl 


From  E„  **„.  Figure  1.  .nd  .he  ueriou.  defining  e-fuaiion.  .boy.  on.  obuine 
the  •imulUneou*  confidence  b*nd  statement: 

'  ^R<-V-Vo> 

Vo>  -  Vo>  *  >'.I'V  -Vo^Vo’ 

■  Prob  |Vo>l-Vo>  ^IwUlVo’K'V 

$.«„>,  -*Vo>*VV  <Vo>^W 


>  p0  (Ml 


(lc=  1  *  •  •  •  i  <l) 
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B.  THE  A PP L4C A  TION  OF 

COHERENCE  FUNCTIONS  TO  NONLINEAR  MULTIPLE-INPUT 
SINGLE- OUTPUT  TIME  INVARIANT  SYSTEMS 


Consider  q  time  functions  x^(t),...  ,x^(t)  in d  s  time  function  y(t) 
now  related  by  the  equation: 


y(t)  =  Xj  x^  (f )  +  K2  x2(t)  +  . . .  +  K^x^(t) 


(31) 


In  Eq.  (31)  the  ,  k=l,. . .  ,  q  denote  time  invariant  operators  here  not 
(necessariiy)linear.  The  operators  ,  k=l,...,q  are  presumed  to  be 
unknown.  Equation  (31)  describes  a  multiple-input  single-output  (possibly) 
nonlinear  time  invariant  system. 

Suppose  a  single  finite  realization  0  <  t  <  T  of  each  of  the  functions 
Xj(t), ...  ,x^(t),  y(t)  is  observed  (recorded).  Suppose  furthermore  that  the 
finite  length  (0  <  t  <  T)  of  records  ^x.(t),...  ,  x  (t),  y(t)jaro  treated  as  if 
they  were  a  finite  realization  of  a  fe+l)th  order  multiple  stationary  time  series. 
Proceeding  by  the  method  of  spectral  estimation  of  Reference  1,  a  (q+l)x(q+l) 
sample  spectral  density  matrix  at  frequency  f. 


2<y  ^ 


2„<v 

t 

1 

1 

1 

$  ( £. ) 
xy  0 

'  T  ’ 
1 

1 

1 

£  (fj 
yy  o'  J 

(32) 


may  then  be  computed.  It  is  presumed  that  the  degrees-of-freedom  oaramet er 
n  associated  with  &(fg)  satisfies  n  £  q+1  ,  and  that  the  qxq  matrix 
is  nonsingular. 

The  reader  will  note  that  the  (possibly)  nonlinear  time  invariant  system 
described  by  Eq.  (31),  in  general,  may  be  different  from  the  linear  time 
invariant  system  described  by  Eq.  (12).  The  reader  will,  however, 

A  —  " 

note  that  from  the  sample  spectral  density  matrix  £(fg)  of  Eq.  (32)  one  may 
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formally  compute  all  the  sample  entities  described  in  Section  2.  The  topic 

that  is  now  briefly  discussed  is  the  relevance,  interpretation,  and  dsefulness 

of  such  sample  entities  in  relation  to  a  multiple-input  single-output  (possibly) 

nonlinear  time  invariant  system  described  by  Eq.  (31). 

In  the  present  discussion  it  is  presumed  that  £  x^  (t), ....  x^(t)J 

multiple  stationary  random  functions.  Since  the  operators  K,,  k=l,...,q 

x^/5, . . .  ,x  (t),  y(t)J  are  also  multiple 

stationary  random  functions.  Furthermore,  it  follows  that  &(fg)  of  Eq.  (32) 

is  then  an  estimator  of  the  (q+ 1  )x (q+ 1 )  spectral  density  matrix  2(f)  of 

^Xj(t), .  . .  ,x  (t),  y(t)j  at  frequency fQ  .  Even  though  y(t)  is  determined 

by  x  j  (t ),...,  Xq(t)  in  the  (possibly)  nonlinear  manner  described  by  Eq.  (31), 

there  is  an  interpretation  that  enables  the  relation  between  y (t)  and 

x.(t),.  .  .  ,x  (t)  to  be  described  by  the  block  diagram  illustrated  by  Eq.  (13). 

* 

Stated  another  way,  one  may  write  Eq.  (31)  in  the  form  of  Eq.  (12)  provided 

one  properly  defines  . and  e(t)  of  in  relation  to  Eq.  (31). 

Since  £x^(t), .  . .  ,x  (t),  y(t)J are  multiple  stationary  random  functions,  there 
exists  a  unique  decomposition  of  y(t)  where  1 


Since  £x^(t), . . .  ,  x^(t),  y(t)j are  multiple  stationary 
exists  a  unique  decomposition  of  y(t)  where  ( 


y(t)  =  yL(t)  +  ye(t) 


In  Eq.  (33),  y.  (t)  ie  the  part  of  y(t)  that  is  related  to  x.  (t), . . .  ,x  (t)  by 

u  S,  1  q 


the  equation 


Y  r  (*)  '  =  L,  *,(t)  +  L  X  (t)  /  . .  .  4-  L  X  (t) 
'  ii  cl  q  q 


jvhejyKttTe  ,  k=i, .  .  .  ,q  In  Eq.  (34)  denote  linear  time  Invariant  operators 

possessing  corresponding  frequency  response  functions  «*<'>•  k=1 . “■ 

In  Eq.  (33),  y^ (t)  is  the  part  of  y(t)  that  is  multiply  incoherent  with 
x i  (t), . .  .  ,x^(t).  If  the  (q+  l)x(q+ 1)  spectral  density  matrix  of  £  (t), . . .  ,  x^(t), 

of  Eq.  (31)  is 
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m e 


2  (f) 

XX 


2  (f) 
.  y* 


2  (f) 

xy 


2  a) 
yy 


thee,  the  H^(f)  Corresponding  to  the  ,  k=l , .  . .  , q  ,  of  Eq.  (34)  are  given 
bY  * 

Htf)  =  [Hjtf). ....  H  (f)]  '  =  2^(f)  Z .(f)  ( 


From  the  preceding  discussion  one  then  kas  the  block  diagram  (13) 
holding  for  Eq.  (31)  where  fl^(f),  k=l, ...» q  arc  given  by  Eq.  (36)  and 
eft)  of  Eq.  (13)  is  replaced  oy  y  (t)  =  y(t)  -  y  (t).  One  has  y  (t)  multiply 
incoherent  with  x.(t),...,x  (t).  From  Eq.  (33)  cnc  may  interpret  y  (t) 

1  C|  6 

to  be  that  part  of  y(t)  of  Eq.  (31)  that  is  unaccounted  for  by  the  linear  time 

invariant  operators  L^,  k-!,...  ,q  of  Eq.  (34)  that  "best"  approximate 

y(t)  by  acting  on  the  inputs  x^(t),.  .  .  ,  x^(t).  In  summary,  one  is  able  to 

write  Eq.  (31)  in  the  form  Eq.  (12)  provided  e(t)  of  Eq.  (12)  is  replaced 

by  y  (t).  In  Section  2,  eft)  was  presumed  to  be  a  zero  mean  stationary 
© 

Gaussian  random  function  statistically  independent  of  the  input  functions 

x^(t),  k=l,.  . .  ,q.  Here,  y#(t)  i»  a  random  function  multiply  incoherent  of 

the  input  functions  jX^(t),  k=l,. . .  ,q.  The  applicability  of  the  results  of 

Section  2  to  describing  (or  approximating)  nonlinear  time  invariant  systems 

by  linear  time  invariant  systems  therefoxe  depends  on  how  the  differing 

properties  of  yg(t)  and  eft)  affect  the  resxilts  of  Section  2, 

^Generally  speaking,  the  sample  entities  of  Section  2'  maintain  their 

relevance,  interpretation ,s  and  usefulness.  For  example,  Eq.  (16)  for 

ii'ffg)  in  the  possibly)  nonlinear  context  of  this  section  is  now  interpreted 

to  be  an  estimator  at  frequency  f^  for  the  matrix  frequency  response 

function  H* (f)  of  Eq.  (36).  The  sample  multiple  coherence  (fn) 

y-  Xj, ...  ,X^  U 

at  frequency  f  between  the  output  y(t)  and  the  q  inputs  x,(t),...  ,x  (t)  is 
U  1  Q 
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now  interpreted  ti>  be  an  estimator  of  the  multiple  coherence  y  (fn)» 

y*  a  ,»*«•>  x  u 
✓  1  q 

i.  e. ,  an  estimator  of  the  degree  to  which  the  output  y(t)  at  frequency  f^  is 
related  by  linear  time ‘invariant  operators  to  €he  q  inputs  x^(t), ...  ,  x^(t). 

The  remaining  question  concerns  the  applicability  of  the  sampling 

/ 

distribution  and  confidence  band  results  of  Sections  1  and  2.  The  output  y(t) 
of  a  time  invariant  nonlinear  system  is,  in  general,  a  non-Gaussian  random 
function  even  if  the  inputs  x^(t)/i . .  ,  x^(t)  are  multiple  stationary  Gausrian 
random  functions.  The  sampling  distribution  and  confidence  band  results  of 
Sections  1  and  2  are  based  on  Gaussian  theory  prevailing  in  the  frequency 
domain.  The  computation  of  the  sample  entities  of  Section  2  inherently  involves 
"narrow  band  frequency  filtering.  "  An  important  result  often  observed  in 

practice  is  that  many  stationary  non-Gaussian  random  functions  become  nearly 

/ 

Gaussian  when  so  ."filtered.  "  Thus,  one  may  expect  the  distribution  and  ' 

confidence  band  results  of  Sections  1  and  2  to  be  approximately  valid  for 

<•  • 

many  multiple  stationary  non-Gaussian  random  functions.  In  that  regard, 
one  may  expect  tne  sampling  distribution^ad^crbhfidence  band  results  of 
Sections  1  and  2  to  be  \k  many  cases  approximately  applicable  to  the  method 
of  studying  nonlinear  systems  describe^iabove. 

The  reader  will  note  that  the  methods  of  this  section  indicate  how  a 


(possibly)  nonlinear  time  invariant  system  may  be  (a)  approximated  by  a 
linear  time  invariant  system,  and  (b)  provide  a  measure  (sample  multiple 
coherence)  of  how  accurate  (at  each  frequency  f^)  such  a  linear  time  invariant 
system  approximation  is.  The  methods  of  this  section  may  therefore  also 
be  roughly  used  to  test  the  hypothesis  that  a  time  invariant  system  is  linear. 
The  general  idea  is  that  a  time  invariant  system  capable  of  being  suitably 
approximated  by  a  linear  time  invariant  system  may  for  many  practical 
purposes  be  regarded  as  a  linear  time  invariant  system. 
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